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AMENDED APPEAL BRIEF UNDER 37 CFR 1.192(a) and 37 CFR 1.136(a) 

I. Real Party In Interest 

The real party interest in this appeal is TransCore, Inc., a corporation 
("Appellant"), and owner of United States patent application number 09/239,671 , entitled 
"Digital Video Audit System" (the "Application"). 

II. Related Appeals and Interferences 

There are no other appeals or interferences known to Appellant or to Appellant's 
legal representative which will directly affect or be directly affected by or have a bearing 
on the Board of Patent Appeals and Interferences' ("the Board") decision in this appeal. 

III. Status of Claims 

The pending claims at issue are set forth in Exh. 1 . The current status of each 
claim in the case, including whether such claim is canceled, allowed, or rejected, and 
whether such claim is on appeal is set forth below: 
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CLAIM NO. STATUS ON APPEAL 

-I Rejected Yes 

2 Rejected Yes 

3 Rejected Yes 

4 Rejected Yes 

5 Rejected Yes 

6 Rejected Yes 

7 Rejected Yes 
g Rejected Yes 

9 Rejected Yes 

10 Rejected Yes 

1 1 Rejected Yes 

12 Rejected Yes 
-1 3 Rejected Yes 
-j 4 Rejected Yes 

15 Rejected Yes 

16 Rejected Yes 

17 Rejected Yes 

18 Rejected Yes 

19 Rejected Yes 

20 Rejected Yes 

21 Rejected Yes 

22 Rejected Yes 
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CLAIM NO. 


STATUS 


ON APPEAL 


23 


Rejected 


Yes 


24 


Rejected 


Yes 


25 


Rejected 


Yes 


26 


Rejected 


Yes 


27 


Rejected 


Yes 



IV. Status of Amendment 

The claims are currently as found in the original application, together with the 
amendment to Claim 12 as presented in the Response to Office Action dated 
August 23, 2001. 

V. Summary of the Invention 

The present invention is directed to a system for collecting and organizing video 
images and data associated with a transaction into a single database. The system 
includes a database management system for the organizing and data retrieval. 

The present invention is used in applications where large amounts of video and 
non-video data for transactions must be quickly stored for and retrieved. One use of the 
invention is in connection with the toll plaza data. Toll plazas on highways must store, 
for each vehicle passing by each toll booth, video data in the form of license plate 
information, as well as the non-video transactional data such as the time of day, the toll 



28539613.2 99604845 



3 



charged, etc. Such data must be quickly retrievable in connection with the audits 
performed by governments on the toll booth data. 1 

The key to this system is the use of a database controlled by a database 
management system to quickly store the video images and transaction data, and to 
organize that data for fast retrieval. The use of the invention in the toll plaza 
environment discussed above is shown in Figs. 1 and 2. A video camera 8a or 8b is 
used to make a video record of each transaction by a vehicle passing through a toll 
plaza. That video data is transmitted to a computer system 30. The video data enters 
the computer through a video splitter 32 and is processed by a video digitizer 30b that 
converts the analog images into digital images. 

At the same time, non-video toll collection data is sent to the computer 30 via a 
port 30a. These data signals represent the collection of money from drivers, the type of 
vehicle, the time and date of the toll collection, etc. The port and the video digitizer 
communicate through a bus network 30d to a File Management System 30c. The File 
Management System receives the digitized video and the toll plaza data, organizes and 
synchronizes that data, and then forwards it for storage through a network 36 to a 
centralized database 37. That database 37 stores the various data and also can be 
coupled to other toll plaza systems for receiving and processing similar data. 



1 Vehicles are typically charged different rates depending upon their respective 
sizes. A two axle vehicle is charged less than a three axle vehicle and both are charged 
less than a four axle vehicle. Toll booth operators must accurately collect the amount of 
money depending upon the vehicle. If toll booths consistently charge the incorrect 
amount, the municipality could see a substantial loss over a protracted period of time. 
Thus, an audit system is needed to check too booth collectors and make sure they are 
not making consistent mistakes or, worse, taking money from the municipality. 
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The process of storing transactional toll data and video data is depicted in Fig. 5. 
In response to a trigger signal activated by the vehicle, the cameras take an image of 
the lanes and the transaction data is gathered. The File Management System collects 
all of this data and builds the appropriate application files in step S55 of Fig. 5. The 
information in the toll plaza data table and in the video image data table are transferred 
to the centralized database 37 for data archiving purposes. Figs. 4a-c show the 
organization of the synchronized transactional and video data within the database. The 
transactional data is stored in a toll plaza data table 45, and the images are stored in an 
image data table 47. 

When data retrieval is desired, the centralized database 37 receives a user 
request. The server 38 attached to the database 37 organizes the data in a format that 
the client 39 can display to the user. Fig. 7 shows the data formatting that occurs upon 
retrieval. As depicted therein, the video image and toll transaction data are merged into 
a single display for use by a user. As discussed in the specification, data can be 
displayed in a variety of formats. Specific queries can also be sent to the database in 
order to allow customized retrieval. 

As also discussed in the specification, while a relational database is 
contemplated, other kinds of database known to one of ordinary skill in the art can also 
be utilized such as object-oriented databases, distributed databases, and hierarchical 
databases can be utilized.' 
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VI. Issues On Appeal 

The issues that Appellant wishes the Board of Patent Appeals and Interferences 

to review in this appeal are: 

1. Whether Claims 1-10, 21, and 24-26 are properly rejected under 35 
U.S.C. § 102(e) as being anticipated by Katz, U. S. Patent No. 5,920,338 (Exh. 2). 

2. Whether Claims 11-20, 22-23, and 27 are properly rejected under 35 
U.S.C. § 103(a) as being unpatentable over Katz. 

VII. Grouping of Claims 

Appellant submits that the claims do not stand or fall together for the reasons 

discussed in § VIII.A. 

VIII. Argument 

A. The Claim Groupings 

There are four claim groups. Claims 1-11 relate to a system for collecting and 
organizing data. Claims 12-20 relate to a method of creating a transaction-based 
database. Claims 21-23 relate to a system for collecting transaction data. Claims 24- 
27 define a database system. These groupings are patentably distinct, which is the 
reason for the groupings. 

B. The Final Office Action 

The Final Office Action in this case was mailed on November 27, 2001 (Exh. 3). 
It is from this Final Action that this appeal ensues. As stated therein, the Examiner 
objected to Claims 1-10, 21 , 24-26 under 35 U.S.C. § 102(e) on the basis of Katz, U. S. 
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Patent No. 5,920,338. The Examiner also rejected Claims 11-20, 22-23, and 27 under 
35 U.S.C. § 103(a) as unpatentable over Katz. 

The prosecution in this case was very abbreviated because of the position taken 
by the Examiner. The initial Office Action in this case mailed June 21, 2000 (Exh. 4) 
made these same rejections. Appellant's Response to that Office Action dated 
August 23, 2001 (Exh. 5) traversed these rejections and requested reconsideration, 
amending Claim 12 in the process. The Examiner's response on November 27, 2001 
was to simply reassert the same rejections and to make them final. 

C. The Rejections Under 35 U.S.C. § 102(e) Are Improper 

The sole basis for all of the rejections by the Examiner is U. S. Patent No. 
5,920,338 issued to Katz (Exh. 2). The Examiner stated that "Katz discloses an 
asynchronous video event and transaction data multiplexing technique for [a] 
surveillance system comprising: a video camera 16 or a plurality of cameras 100, 102, 
104 for capturing video images of a transaction; an input device 20 for collecting data 
associated with the transaction [and] a database m anagement system 14 for organizing 
the video images and data associated with the transaction" (emphasis added). 

The Examiner's analysis is simply incorrect, particularly with regard to the 
supposed "database management system for organizing the video images and the data 
associated with the transaction." As a close review of Katz will indicate, the Examiner 
has misunderstood the fundamental nature of the Katz system. Katz is not directed at 



2 In the November 27, 2001 Office Action, the Examiner stated in the second 
sentence on page 4 that "the Applicant failed to challenge the rejection [under section 

(cont'd) 
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an to establishing a single database to record both video images and data associated 
with a transaction. Instead, and as a review of Fig. 1 of Katz will indicate, the only 
"database" is the transaction database 14 used to store non-video transaction data. 
That transaction database is even stored in a different media than the video images 
taken by the camera 16. The video images in Katz are simply recorded on a VCR or 
similar recording mechanism 22. 

Thus, at the outset, there is absolutely no teaching in Katz regarding a common 
synchronized video/transaction data database. Moreover, there is no teaching of such 
a database in Katz in the context of a database with a query structure such that a query 
into the database using a portion of the transaction data acts as a key to retrieving the 
image correlated to that data. The crucial distinction between Appellant's invention and 
Katz is that Appellant's invention, as defined in Claim 1, is a system, with a database 
management component, for collecting and organizing transactional data and video 
images and data associated with a transaction into a database. Katz's system is not 
such a system. Likewise, as indicated in Claim 12, Appellant's invention is a method of 
creating a transaction database comprising the steps of storing an image of a 
transaction and video data connected to the transaction in a database such that a query 
into the database using a portion of the data acts as a key for retrieving the image 
correlated to the data. Katz does not disclose this aspect of the invention. 



(... cont'd) . . 

103(a)]." As a review of the August 23, 2001 Office Action will indicate, however, that 

assertion is simply incorrect. 
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Katz has the same problems as the prior art discussed in the Background of the 
Invention. That art frequently uses video tape storage of images separate from the 
storage of the transaction. Indeed, Katz is directed to a surveillance system which 
asynchronously (i.e., without being phased or in step) records the video signals 
corresponding to events on one medium (videotape) and transaction data in another 
medium. 3 To achieve playback of this information, the system requires that the 
transaction data, which is stored separate and apart from the video, be matched with 
the video being replayed from videotape. As was repeatedly pointed out to the 
Examiner during prosecution, a thorough review of Katz provides no teaching or 
suggestion regarding Appellant's storage of both transactional data and video images in 

a single database as claimed. 

In fact, the distinct nature of the present invention and Katz is highlighted by the 
Examiner's recognition that Katz is an asynchronous relative to the storage of the 
transactional data in the transaction database and the storage of the video images on 
the videotape. The asynchronous nature of Katz is what requires the Katz system to 
generate sequencing signals that are associated with the transaction data and video 
signals to allow the signals to be brought together at a later time. 

By contrast, the present invention is a synchronous system in which the digitized 
video data and the transactional data are stored in tables on the same storage media 
such as a disk drive. The present invention combines the data from the digitized video 



3 Katz's system has two separate units to store video images related to a 
transaction as well as the separate transaction data. As a result of the utilizing of these 



(cont'd) 
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images with clock/calendar data and toll plaza data into the database together as a 
ongoing and synchronous process such that the data is organized by the File 
Management System for retrieval as soon as it is stored. Once stored, that 
synchronized video and transaction data can be quickly retrieved with a database 
query. 

Katz cannot provide the quick retrieval required by the demanding application 
environment of the present invention. As described, Katz uses separate storage units 
for video and transactional information, along with requires an entirely separate 
structure that provides correlation between the two separately stored transaction data 
and video data. Katz thus requires the searching of two completely different data 
sources to find related information. Searching a VCR for video information, particularly 
non-digitized video information, is exceedingly slow. In contrast with Katz, the present 
invention utilizes a single database for quickly storing and retrieving both video and 
corresponding data relating to the video information. This is a significant improvement 
to the system of Katz, particularly since the retrieval is done via a single transactional 
identifier, rather that the laborious searching of two different data sources in Katz to look 
for matching data. 

In the final Office Action, under the heading "Remarks," the Examiner, stated as 
follows in response to Appellant's contentions that there was no common 
video/transaction database within Katz: 



twoTeparate and distinct storage media, it is necessary in Katz that each media include 
data identification signals. See Katz at col. 2, Ins. 60-67 
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In response to Applicant's general argument that Katz 
(5,216,502) does not disclose having both transactional data 
and video data in a database, [sic-,] the Examiner 
respectfully disagrees. Katz discloses having both 
transaction data from the lane controller, frames of video, 
and including additional data to be recorded at the database 
50 within the database system 40 (see col. 9, Ins. 19-53). 

From the outset, this is a different Katz patent that formed the basis for the 
rejections interposed by the Examiner. The '502 Katz patent (Exh. 6) does not disclose 
a database as item 50. Instead, item 50 in the '502 patent is a video cassette recorder. 
Item 50 in the '338 patent is a video input. Accordingly, the Examiner's comments on 
page 3 of the final Office Action are at best puzzling and at worst simply incorrect. 

The Examiner went on to state as follows: 

Furthermore, the Applicant claims that a "database 
management system for organizing the video images and 
data associated with the transaction into a database." The 
Applicant does not claim in Claims 1 and 12 having both 
transactional data and the video data in the same database. 
The Applicant's argument is not persuasive. 

This statement is equally mystifying. The term "a database" clearly means the 
same database. Appellant did not state a plurality of databases or different portions of 
different databases. Appellant clearly stated "a" database. There is no way to read that 
phrase except that the video and transactional data are combined into the same 
database. It is respectfully submitted that the Examiner's analysis of the claim is simply 
wrong. 

In summary, by its own disclosure, as well as by the Examiner's own 
characterization of it as an "asynchronous" system, Katz is not a § 102 reference. In 
particular, once the Examiner's erroneous determination relative to the database 
management system is made clear, Katz should be removed completely as a rejection. 
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Katz does not anticipate any of the groups of claims. The first group of claims, 
based on independent Claim 1, requires that "database management system for 
organizing the video images and data associated with the transaction into a database." 
That element is completely missing from Katz. 

The second group of claims, based upon independent Claim 12, requires the 
"storing the image and the data into a database such that a query into the database 
using a portion of the data acts as a key for retrieving the image correlated to the data." 
That element is completely missing from Katz. 

The third group of claims, based upon independent Claim 21, requires "a 
computer system for correlating additional data with each image," together with a 
"storage system for storing the images and the additional data." These elements are 
absent from Katz due to its asynchronous nature because Katz does simply not 
correlate (at the time of storage) or store together the images and the data, and instead 
does no more than place identification signals in each of the two storage media for later 
correlation. 

Relative to the fourth group of claims, based upon Claim 24, Katz does not teach 
a "storage medium for storing the first and the second image wherein the first and 
second image are correlated via the identifier." The entire technology of Katz is 
different. The storage of the transactions and video data into a database for easy 
retrieval using query instructions so that a particular transaction and its corresponding 
image are quickly retrieved is completely missing from Katz. 

The § 102 rejections should be reversed. 
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D. The Rejections Under 35 U.S.C. § 1 03 Are Improper 

The Examiner rejected Claims 11-20, 20-23 and 27 as being unpatentable over 
Katz. The Examiner stated, without citation to any prior art, that whatever was missing 
from Katz relative to these claims was supplied by the prior art, leading the Examiner to 
conclude that all aspects of these claims were obvious. 

The Examiner's statements regarding Claims 11, 22, 23 and 27 are particularly 
confusing. The Examiner states that Katz fails to suggest video signals can be captured 
based upon "a barcode reader reading a bare [sic-bar] code label." Claims 22 and 23 
do not deal with barcode readers, as do Claims 1 1 and 27. As such, the rejection is 
mystifying. In any event, the fundamental flaw of the Examiner relative to the database 
issue, when combined with the admission of the Examiner as to the failure of Katz to 
teach barcodes, only underscores the inappropriateness of Katz as a § 103 reference. 

Regarding Claims 12-20, the Examiner again concedes that Katz fails to teach 
using a portion of the data as a key for retrieving the image correlation data. The 
Examiner then concludes, again without citation to prior art, that that this part of the 
invention is old, so as to allow him a reach a conclusion of obviousness for these 
claims. As discussed above, the concession of the lack of teaching of Katz as to using 
a key, when combined with the lack of teaching of Katz as to the database, should 
completely remove Katz as a § 103 reference. 

Thus, as to each of the four groups of claims, the Examiner's § 103 rejections so 
completely missed the mark that rejections should be reversed as to each group. 
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IX. Conclusion 

For each and all of the foregoing reasons, Appellant respectfully submits that the 
§ 102 and § 103 rejections should be reversed and pending claims allowed. 



Dated: October 7, 2002 By: 




Mayer, Brown, Rowe & Maw 
350 S. Grand Avenue, 25 th Fl. 
Los Angeles, CA 90071 
Tel: (213)229-9518 

Attorneys for TransCore, Inc. 



28539613.2 99604845 



14 



EXHIBIT 1 



EXHIBIT 1 

The following claims are involved in this appeal: 
CLAIM NO. 

1 . A system for collecting and organizing data comprising: 

a video camera for capturing video images of a transaction; 
an input device for collecting data associated with the transaction; 
a database management system for organizing the video images and the 
data associated with the transaction into a database. 

2. The system of claim 1 wherein the data associated with the transaction 
includes time data. 

3. The system of claim 1 wherein the data associated with the transaction 
includes date data. 

4. The system of claim 1 wherein the data associated with the transaction 

includes monetary data. 

5. The system of claim 1 wherein the video images are captured based upon 
a signal that is produced in response to the input device collecting data. 

6. The system of claim 1 wherein the images are captured based upon a 

clock signal. 

7. The system of claim 1 further comprising: 

a terminal for allowing an operator to input queries into the database and 
receive the image and the data associated with the transaction in response to the 
queries. 

8. The system of claim 1 wherein the transaction is a toll collection. 

9. The system of claim 1 wherein the transaction is a financial transaction. 

28539613.1 99604845 1 



1 0. The system of claim 1 wherein the transaction is a retail transaction. 

11. The system of claim 1 0 wherein the video images are captured based 
upon a bar code reader reading a bar code. 

1 2. A method of creating a transaction based database comprising: 
capturing an image of the transaction as the transaction occurs; 
collecting data correlating to the transaction; 

storing the image and the data into a database such that a query into the 
database using a portion of the data acts as a key for retrieving the image 
correlated to the data. 

13. The method of claim 12 further comprising: 

triggering the capturing of the image based on the collecting of data. 

14. The method of claim 12 further comprising: 

triggering the capturing of the image based on a clock signal. 

1 5. The method of claim 1 2 further comprising: 

retrieving the image and the data from the database in response to the 

query. 

16. The method of claim 15 further comprising: 

displaying the image and the data on a monitor for an operator to view. 

17. The method of claim 16 wherein the operator makes adjustments to the 

data stored in the database. 

1 8. The method of claim 1 5 further comprising: 

displaying the next image and associated data on the monitor in response 
to the operator issuing a request to view the next image. 



28539613.1 99604845 



2 



1 9. The method of claim 1 5 further comprising: 

displaying the next image and associated data on the monitor in response 
to the operator issuing a request to view the next transaction in time. 

20. The method of claim 1 5 further comprising; 

displaying the next image and associated data on the monitor in response 
to the operator issuing a request to view the next transaction with a particular 
value in a particular data field. 

21 . A system for collecting data about a transaction comprising: 

a camera for capturing images of documents related to the transaction; 
a trigger system for triggering the camera to capture the images; 
a computer system for correlating additional data with each image; and 
a storage system for storing the images and the additional data. 

22. The system of claim 21 wherein the trigger system is comprised of: 
at least one light emitter that emits at least one beam of light; 

at least one light detector for detecting the at least one beam of light; and 
a pulse generator which outputs a pulse in response to the at least one 
light detector detecting an object breaking the at least one light beam. 

23. The system of claim 22 wherein the object is a financial document. 

24. A database system comprising; 

a camera for capturing a first and a second image, 
a generator for generating an identifier; 

a storage medium for storing the first and the second image wherein the 
first and the second image are correlated via the identifier. 
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25. The database system of claim 24 further comprising; 

an input device for receiving transaction based data related to the first and 

second image. 

26. The database system of claim 25 wherein the input device includes a toll 
collector. 

27 The database system of claim 25 wherein the input device includes a bar 
code reader. 
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Applicantmaynrtre^^ 

II) D The proposed drawing correction filed on is: .,□ approved b)D disapproved by the Exam.ner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 

Priority under 35 U.S.C. §§ 119 and 120 

13) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a)D A" b)D Some • c)D None of. 

1 □ Certified copies of the priority documents have been received. 
2.Q Certified copies of the priority documents have been received in Application No. 

■ . _ i _ _ _ iiaaai\ in Tin 



3 □ Copies of the certified copies of the priority ^ ^ h ** **** 

U application from the International Bureau (PCT Rule 17 2(a))_ 
* See the attached detailed Office action for a list of the certified cop.es not rece.ved. 
UO ~dgment is made of a Cairn for domestic priority under 35 U.S.C. , 1 19(e) (to a P rovis,on, appl.cat.on). 

a) D The translation of the foreign language provisional applicator, has been rece^ 
15)D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 

Attachments lntefvi ew Summary (PTO-41 3) Paper No(s) • 

1) Q Notice of References C.ted (PTO-892) „ N ticeof|nforma ,p aten t Application (PTO-1 52) 

2) □ Notice of Draftsperson ! s Patent Drawng Rev.ew (PTO-948) 5 U «« 

3) M Information Disclosure Statement(s) (PTO-1449) Paper No(s) 3 . B)U O™- 
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DETAILED ACTION 

1. Receipt is acknowledged of the amendment filed 8/23/01 in which claim 12 has been 

amended. 

Claim Rejections - 35 U.S.C. §102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless -- 

f the invention was described in a patent granted on an application for patent by another filed in *e United 
4« before the invention thereof by the applicant for patent, or on an international application by another who 

of paragraphs (1), (2), and (4) of section 371(c) of this title before the mvention 

thereof by the applicant for patent. 

3. Claims 1-10, 21, and 24-26 are rejected under 35 U.S.C. 102(e) as being anticipated by 
Katz,US Patent No. 5,920,338. 

Katz discloses an asynchronous video event and transaction data multiplexing technique 
for surveillance system comprising: a video camera 16 or a plurality of cameras 100, 102, 104, 
for capturing video images of a transaction; an input device 20 for collecting data associated with 
the transaction; a database management system 14 for organizing the video images and data 
associated with the transaction (see figures 1 -2; col. 4, line 3 6+). 

Re claims 2-4, the data associated with the transaction includes time data, date data, and 
monetary data (see col. 8, lines 59-68 and col. 10, line 11). 

Re claim 5, wherein the video images are captured based upon a signal that is produced 
in response to the input device collecting data (see figure 7; claim 1). 

Re claim 6, wherein the images are captured based upon a clock time signal (see col. 6, 

lines 18-36). 
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Re claim 7, a terminal for allowing an operator to input queries into the database and 
received the image and data associated with the transaction in response to the queries ( see col. 6, 

line 60 to col. 7, line 39). 

Re claims 8-10, the transaction is a toll collection (financial collection) and /or grocery 

purchasing (retail) (see col. 7, lines 21-26). 

Re claims 21, 24-26, the limitations have been met above. 

Claim Rejections - 35 U.S.C. § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 02 of this title, if the differences between the subject matter sought to be patented and the : pno, ■« t are 
such that the subject matter as a whole would have been obvious at the time the mvent.on was made to a person 
Sng tS STn the art to which said subject matter pertains. Patentability sha.l not be negat.ved by the 
manner in which the invention was made. 

5. Claims 1 1-20, 22-23, and 27 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Katz. The teachings of Katz have been discussed above. 

Re claims 1 1 , 22, 23, and 27, Katz fails to disclose or fairly suggests that video signals 
are captured based upon a bar code reader reading a bare code label wherein the bar code reader 
includes an emitter for generating a beam of light and a detector for detecting the beam of light 
wherein the camera is activated when an item breaks the beam of light. However, Official notice 
is taken that bar code readers having emitters for generating beams of lights and detectors for 
detecting the beams of lights are notoriously old and well known in the art for processing retail 
items at POS terminals. Therefore, it would have been obvious to employ a bar code reader at the 
POS terminal of Katz wherein the items would be labeled with bar codes for providing rapid and 
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reliable data entries during video processing wherein the camera would activate when an item 
breaks the beam of light (when an item is scanned). 

Re claims 12-20, Katz fails to disclose or fairly suggest using a portion of the data as a 
key for retrieving the image correlated data. However, Official notice is taken that this is old and 
well known in the art that relational databases use a portion of the data as a key (a primary key or 
an index) for retrieving the stored data. Furthermore, relational databases are known to provide 
greater storage space. Therefore, it would have been obvious to utilize a relational database for 
storing the data of Katz wherein a portion of the data would be used as a key for retrieving the 
data. 

Response to Arguments 
6. Applicant's arguments filed 8/23/01 have been fully considered but they are not 
persuasive, (see examiner remarks). 
REMARKS: 

In response to the applicant's general argument that Katz (5,216,502) does not disclose 
having both transactional data and video data in a database. The examiner respectfully disagrees. 
Katz discloses having both transactional data from the lane controller 26, frames of video, and 
including additional data to be recorded at the database 50 within the database system 40 (see 
col. 9, lines 19-53). Furthermore, the applicant claims that "a database management system for 
organizing the video images and data associated with the transaction into a database". The 
applicant does not claim in claims 1 and 12 having both transactional data and the video data in 
the same database. The applicant argument is not persuasive. 
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Re claims 1 1-20, 22, 23, and 27, the examiner took Official notice to reject these claims 
under 35 U.S.C. 103(a). The applicant failed to challenge the rejection. Therefore, the claims 
remain rejected as previously stated in the prior office action. Generally, the applicant's 
argument is not persuasive. Refer the rejection above. 

Conclusion 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 

policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 

date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Daniel St.Cyr whose telephone number is 703-305-2656. The 
examiner can normally be reached on Mon-Fri. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael G Lee can be reached on 703-305-3503. The fax phone numbers for the 
organization where this application or proceeding is assigned are 703-308-7721 for regular 
communications and 703-308-7724 for After Final communications. 
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Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-308-0956. 



Daniel St.Cyr 
Examiner 
Art Unit 2876 
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Examiner 



Daniel St.Cyr 



&l Responsive to communication(s) filed on Jan 29, 1999 . * 

□ This action is FINAL. 

□ Since this application is in condition for allowance except for -formal ' 88 t0 the me " tS iS Cl ° Sed 
in accordance with the practice under Ex parte Quayle, 1935 CD. 11; 453 O.G. 213. 

A shortened statutory period for response to this action is set to expire 3_ month(s) or thirty days 

ts longer rom the maiUng date of this communication. Failure to respond within the ponod for response will cause the 
appS^^^ abandoned. (35 U.S.C. § 133). Extensions of time may be obtained under the prov.s.ons of 

37 CFR 1.136(a). 



Disposition of Claims 

K Claim(s) 7-27 



is/are pending in the application. 



Of the above, claim(s) 
□ Claim(s) 



E Claim(s) 7-27 

□ Claim(s) 

□ Claims 



is/are withdrawn from consideration. 

is/are allowed. 

is/are rejected. 

is/are objected to. 



are subject to restriction or election requirement. 



Application Papers 

H See the attached Notice of Draftsperson's Patent Drawing Review, PTO-948. 

□ The drawing(s) filed on '»s/are objected to by the Examiner. 

□ The proposed drawing correction, filed on is Cbpproved Disapproved. 

□ The specification is objected to by the Examiner. 

□ The oath or declaration is objected to by the Examiner. 

Priority under 35 U.S.C. § 119 

□ Acknowledgement is made of a claim for foreign priority under 35 U.S.C. § 119(a)-{d). 

□ All □ Some* □ None of the CERTIFIED copies of the priority documents have been 

□ received. 

□ received in Application No. (Series Code/Serial Number) _ • 

□ received in this national stage application from the International Bureau (PCT Rule 17.2(a)). 
"""Certified copies not received: 



□ Acknowledgement is made of a claim for domestic priority under 35 U.S.C. § 119(e). 
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DETAILED ACTION 
Claim Objections 

1. Claim 12 is objected to because of the following informalities: line 2 "it" should be 
changed to -the transaction-. Appropriate correction is required. 

Claim Rejections -35U.S.G§102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless ~ 

(e) the invention was described in a patent granted on an application for patent by another filed in the United 
States before the invention thereof by the applicant for patent, or on an international application by another who 
has fulfilled the requirements of paragraphs (1), (2), and (4) of section 37 1(c) of this title before the invention 
thereof by the applicant for patent. 

3. Claims 1-10, 21, and 24-26 are rejected under 35 U.S.C. 102(e) as being anticipated by 
Katz, US Patent No. 5,920,338. 

Katz discloses an asynchronous video event and transaction data multiplexing technique 
for surveillance system comprising: a video camera 16 or a plurality of cameras 100, 102, 104, for 
capturing video images of a transaction; an input device 20 for collecting data associated with the 
transaction; a database management system 14 for organizing the video images and data 
associated with the transaction (see figures 1-2; col. 4, line 36+). 

Re claims 2-4, the data associated with the transaction includes time data, date data, and 
monetary data (see col. 8, lines 59-68 and col. 10, line 11). 
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Re claim 5, wherein the video images are captured based upon a signal that is produced in 
response to the input device collecting data (see figure 7; claim 1). 

Re claim 6, wherein the images are captured based upon a clock time signal (see col. 6, 

lines 18-36). 

Re claim 7, a terminal for allowing an operator to input queries into the database and 
received the image and data associated with the transaction in response to the queries ( see col. 6, 
line 60 to col. 7, line 39). 

Re claims 8-10, the transaction is a toll collection (financial collection) and /or grocery 

purchasing (retail) (see col. 7, lines 21-26). 

Re claims 21, 24-26, the limitations have been met above. 

Claim Rejections - 35 V.S.C §103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 

rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claims 1 1-20, 22-23, and 27 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Katz. The teachings of Katz have been discussed above. 

Re claims 1 1, 22-23, and 27, Katz fails to disclose or fairly suggests that video signals are 
captured based upon a bar code reader reading a bare code label wherein the bar code reader 
includes an emitter for generating a beam of light and a detector for detecting the beam of light 
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wherein the camera is activated when an item breaks the beam of light. However, Official notice is 
taken that bar code readers having emitters for generating beams of lights and detectors for 
detecting the beams of lights are notoriously old and well known in the art for processing retail 
items at POS terminals. Therefore, it would have been obvious to employ a bar code reader at the 
POS terminal of Katz wherein the items would be labeled with bar codes for providing rapid and 
reliable data entries during video processing wherein the camera would activate when an item 
breaks the beam of light (when an item is scanned). 

Re claims 12-20, Katz fails to disclose or fairly suggest using a portion of the data as a key 
for retrieving the image correlated data. However, Official notice is taken that this is old and well 
known in the art that relational databases use a portion of the data as a key (a primary key or an 
index) for retrieving the stored data. Furthermore, relational databases are known to provide 
greater storage space. Therefore, it would have been obvious to utilize a relational database for 
storing the data of Katz wherein a portion of the data would be used as a key for retrieving the 
data. 

Conclusion 

6. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. Clever, US Patent No. 4,145,715, discloses a surveillance system. Coutta et al, US 
Patent No. 4,337,482, discloses a surveillance system. Cotton et al, US Patent No. 4,630,1 10, 
disclose a surveillance system. Katz, US Patent No. 5,216,502, discloses a surveillance system 
for automatically recording transaction. Katz, US Patent No. 5,920,338, disclose an 
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asynchronous video event and transaction data multiplexing technique for surveillance system. 
Ando et al, US Patent No. 6,042,008, disclose a toll collection system of toll road and in-vehicle 
unit for the same. 

Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Daniel StCyr whose telephone number is (703) 305-2656. The examiner 
can normally be reached between the hours of 7:30 AM to 6:00 PM Monday thru Thursday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Donald Hajec, can be reached on (703) 308-4075. The fax phone number for this 
Group is (703)308-5841 or (703) 308-7722. 

Communications via Internet e-mail regarding this application, other than those under 35 
U.S.C. 132 or which otherwise require a signature, may be used by the applicant and should be 
addressed to [donald.hajec@uspto.gov]. 

All Internet e-mail communications will be made of record in the application file. PTO 
employees do not engage in Internet communications where there exists a possibility that sensitive 
information could be identified or exchanged unless the record includes a properly signed express 
waiver of the confidentiality requirements of 35 U.S.C. 122. This is more clearly set forth in the 
Interim Internet Usage Policy published in the Official Gazette of the Patent and Trademark on 
February 25, 1997 at 1 195 OG 89. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the Group receptionist whose telephone number is (703) 308-0956. 
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RFSPONSE TO OFFICE ACTION 



: to the Office Action dated June 21 , 2000, Applicant hereby amends the 



Sir: 

In response 1 
application as follows: 
In the claims: 
Claim 12 (Amended) 

A method of creating a transaction based database comprising: 
capturing an image of the transaction as the transaction [it] occurs; 
collecting data correlating to the transaction; 

storing the image and the data into a database such that a query into the database 
using a portion of the data acts as a key for retrieving the image correlated to the data. 



8853491.1 82301 1605P 99604845 



) 



REMARKS 

Applicant has amended the claims in order to overcome the Examiner's objections 
under 35 U.S.C. § 112. Applicant submits that the amended claims comport with all of the 
requirements of § 1 12 and requests that the Examiner now withdraw this objection. 

Applicant respectfully requests reconsideration of the prior art rejections set forth by 
the Examiner under 35 U.S.C. §§ 102 and 103. Applicant submits that the references of 
record, whether considered alone or in combination, fail to either teach or suggest 
Applicant's presently claimed invention. 

In particular, Applicant notes that the present invention is directed to a system for 
collecting and organizing data, including a database management system for organizing 
video images and data associated with a transaction into a database . See, for example, 
claim 1. As alternately described in claim 12, Applicant's claimed invention is directed to 
a method of creating a transaction database comprising steps of storing an image of a 
transaction and data correlated to the transaction into a database such that a query into the 
database using a portion of the data acts as a key for retrieving the image correlated to the 
data. See, for example, claim 12. Applicant submits that the prior art of record fails to 
provide any teaching or suggestion whatsoever regarding the presently claimed invention 
as described above. 

In particular, Applicant notes that the primary reference upon which the Examiner 
relies in rejecting the claims under 35 U.S.C. §§ 1 02 and 1 03 suffers from the shortcomings 
of the prior art noted in Applicant's description of the background of the invention. 
Specifically, the Katz reference, U.S. Patent No. 5,920,338, is directed to a surveillance 
system which asynchronously records video signals corresponding to behavioral events 

.9- 
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and transaction data. In order to achieve playback of this information, the system requires 
that the transaction which is stored separate and apart from the video information be 
matched with the video information being replayed from a video tape. See, for example, 
the abstract of the disclosure in the Katz reference. 

Indeed, a thorough review of the Katz reference provides no teaching or suggestion 
regarding Applicant's storage of both transactional data and video images in a database 
as claimed. In contrast with the claimed invention, Katz described a system where two 
separate storage units are used for respectively storing video images related to a 
transaction and separate transaction data. As a result of utilization of these two separate 
and distinct storage media, it is absolutely necessary that each media include 
synchronization information or signals stored with the respective video and transactional 
data. This is clearly detailed in the Katz reference in the Summary of the Invention, in 
column 2, lines 60-67. Here the disclosure of Katz recognizes that "the first recording 
means must also store the synchronizing signal." (emphasis added) The digital signals 
are stored separately on the video tape so as not to degrade either the digital signals or the 
video signals. 

In column 3, Katz further states in the Summary of the Invention, that a second 
recording means stores the digital signals along with all other event or transaction data. 
The second recording means also stores the synchronizing signals. See Katz, column 3, 
lines 1-5. A playback means then retrieves the information saved by the two storage 
devices. See Katz, column 3, lines 4-5. In Katz, a control means synchronizes digital data 
from the second recording means with composite video signal by comparing the 
synchronizing by signals stored by both recording means. See specifically, Summary of 
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the Invention at claims 14-16. It is apparent from the Katz disclosure that each storage unit 
must be separately searched in order to retrieve both video and transaction information. 
This is substantially different from the present Information where a database is simply 
searched for the records corresponding to a single identifier. This can readily be 
accomplished by any known database access technique including linked lists, etc. 

The device disclosed in the Katz reference is substantially different than that 
disclosed in the present invention. Specifically, Katz requires an entirely separate structure 
which provides correlation between the two separately stored signals. In contrast with the 
Katz reference, the present invention uses a single database for storing and retrieving both 
video and corresponding data relating to the video information. This is significantly better 
than the system of Katz in that there is no need to spend time searching for two separate 
data stores. Rather, a single transaction identifier is sufficient to more quickly pull the data 
from this single database with a single inquiry. 

In light of the foregoing, Applicant respectfully submits that the references of record 
fail to either teach or suggest the presently claimed invention. Accordingly, Applicant 
requests that the Examiner withdraw the prior rejections and now allow all claims in the 
application. 
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CLEAN VERSION OF AMENDED CLAIM 



Claim 12 

A method of creating a transaction based database comprising: 
capturing an image of the transaction as the transaction occurs; 
collecting data correlating to the transaction; 

storing the image and the data into a database such that a query into the database 
using' a portion of the data acts as a key for retrieving the image correlated to the data. 
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[57] ABSTRACT 
A system for making and reviewing video recordings of 
transactions occurring at cashier lanes uses a television 
camera for developing frames of video signals of the 
transactions at two or more cashier lanes. A register at 
each lane generates digital signals representing events 
that occur at the lanes. A computer responsive to the 
digital signals generates a digital transaction signal. A 
VCR records the camera video signal and the computer 
digital transaction signal on a cassette, the digital trans- 
action signal being recorded in a certain relation (e.g. in 
synchrony) with the camera video signal and in such a 
manner as to substantially not aflect the clarity of each 
video frame. In a playback mode, the VCR generates a 
playback video frame signal, and the computer gener- 
ates an overlay control signal. An overlay means re- 
sponsive to various signals generates a composite video 
signal of an alpha-numeric display of the digital transac- 
tion information relating to the desired cashier lane 
overlaying the video signal, the alpha-numeric informa- 
tion being positioned in the composite video signal so as 
not to obscure that portion of the video frame that 
pertains to the desired cashier lane. In another aspect of 
the invention, a computer responds to the register sig- 
nals and generates a video storage signal at the start of 
a subsequent transaction and a transaction summary 
signal. The overlay means generates a summary snap- 
shot video frame signal comprising alpha-numeric 
transaction summary information overlaying the pic- 
ture of the merchandise at the start of the transaction. 

18 Claims, 4 Drawing Sheets 
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